Efficient coding hypothesis

See Barlow1961possible. Horace Barlow was inspired by Claude Shannon‘s Information theory.

The idea that the sensory system is built to reduce redunduncies and extract the essential information (or “passwords”).

Zbontar2021Barlow uses this idea to build a Self supervised learning method for images.